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As  suggested  in  the  reporting  guidelines  for  ONR  information  systems  pro¬ 
gram  contractors,  this  report  summarizes  the  research  progress  made  at 
Stanford  University  tender  ONR  Order  No.  NR  0‘19-'18n/8-G-82,  Contract 
No.  N000  M-81-K-03033rhe  overall  purpose  of-fec  contract  was  to  support 
basic  and  applied  research  in  the  study  of  interacting'^'iiitclligcnt  agents"5*- 
(I A  s),  each  of  which  was  capable  of  acting  autonomously  in  a  precisely 
specified  domain.  The  principal  application  domain  was  that  of  mi  intelli¬ 
gent  interface  to  a  computer  operating  system. 

Work  in  this  area  split  naturally  into  two  broad  subareas.  The  first 
involved  construction  of  an  individual  intelligent-  agent,  while  the  second 
required  investigation  of  the  issues  involved  in  the  interaction,  between  a 
variety  of  such  agents. 

The  construction  of  a  single  autonomous  agent  in  a{ytomplex  domain 
itself  involved  a  variety  of  problems.  Firstly,  planning  research  needed  to  be 
done  to  investigate  the  problems  that  will  be  encountered  by  a  planner  that 
needs  both  to  observe  its  environment  before  making  plans  and  to  execute 
th  ese  conditionally,  allowing  for  the  possibility  of  failure  along  the  way. 
Intelligent  interaction  with  computer  operating  systems,  including  access 
to  remote  devices,  requires  that  both  of  these  problems  be  addressed. 

Given  these  constraints,  the  domain  is  sulliciently  complex  that  “blind” 
planning  and  inference  are  unlikely  to  manage  the  combinatorial  difficulties 
of  the  problems  encountered.  Research  was  therefore  required  on  the  con¬ 
trol  of  such  inference,  ;is  the  I A  needs  to  be  able  to  introspect  and  control 
its  own  activities. 

Finally,  an  individual  IA  will  need  to  present  its  results  to  the  user. 
This  led  us  to  investigate  the  questions  involved  in  intelligent  presentation, 
as  well  as  those  in  intelligent  planning  and  controlled  inference. 
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The  Intelligent  Agents  domain  is  one  in  which  many  planning  problems  do 
not  have  guaranteed  linear  solutions.  Instead,  it  is  necessary  to  take  steps 
to  gather  information  about  the  state  of  the  world  and  to  then  act  upon 
the  information  gathered.  This  gives  rise  to  plans  which,  instead  of  being  a 
simple  sequence  of  actions,  contain  conditional  IF-THEN-ELSE  constructs. 
In  addition,  such  plans  may  also  contain  “sensory”  actions,  the  purpose  of 
which  are  to  gather  information  rather  than  to  change  the  state  of  the  world. 
An  approach  to  planning  has  been  developed  which  allows  the  construction 
of  conditional-sensory  plans  in  a  natural  manner,  including  cases  where  the 
sensory  actions  themselves  have  prerequisites  which  must  be  achieved  [3]. 
The  formalism  developed  for  planning  has  proven  useful  in  other  design 
problems  (7,8,1)],  and  has  also  given  rise  to  research  on  efficiency  gains 
made  by  exploiting  existing  design  constraints  (-1,5,0].  Finally,  since  most 
planning  and  error  recovery  in  the  1A  domain  is  fairly  standardized,  an 
“expert  system”  style  planner  was  developed  with  extensive  abilities  to 
transfer  files  between  numerous  sites  over  three  networks  anil  to  recover 
from  a  large  number  of  commonly  occurring  errors  [1,2]. 


3  Control  of  Inference 

As  remarked  in  the  introduction,  the  need  to  use  more  than  “canned  plans” 
in  the  IA  domain  led  to  a  clear  need  for  better  and  more  general  strategies 
for  control  of  inference  than  had  previously  been  available.  The  IA  domain 
poses  many  problems  in  which  the  arc  large  conjunctive  queries  to  solve. 
If  improperly  ordered,  these  problems  are  often  intractable,  but  use  of 
knowledge  about  the  number  of  answers  for  the  individual  conjuncts  can 
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lead  to  dramatic  decreases  in  the  number  of  possible  answers  which  must 
be  examined.  A  number  of  results  were  obtained  on  this  problem  [26,29). 
Another  area  of  control  research  investigated  the  problem  of  deciding  when 
a  search  could  be  stopped  because  all  possible  answers  to  the  original  query 
had  already  been  found  [26,27,28]. 

This  work  dovetails  neatly  with  the  more  general  work  on  contiol  of 
inference  which  is  also  in  progress  at  Stanford.  An  area  of  this  more  general 
control  work  which  was  investigated  under  the  IA  project  involved  studying 
the  tradeofT  between  devoting  resources  in  an  attempt  to  find  the  best 
course  of  action  in  solving  a  problem  and  devoting  those  same  resources  to 
a  direct  attempt  at  a  solution.  A  variety  of  situations  were  studied  and  a 
number  of  “break-even”  points  were  discovered  [19). 

4  Intelligent  Presentation 

An  IA’s  activity  will  frequently  involve  the  presentation  to  a  human  user 
of  informaion  about  the  state  of  the  lA’s  world.  If,  for  example,  a  plan 
has  failed  unexpectedly,  it  is  far  better  that  the  user  be  presented  with 
a  sketch  of  what  has  happened  and  where  the  world  stands  now  rather 
than  that  the  machine  simply  aborts  the  plan  in  some  unknown  state!  Not 
.surprisingly,  however,  the  I A  will  have  far  more  information  about  the  state 
of  the  world  than  should  be  presented  to  the  user,  and  the  IA  will  therefore 
need  to  present  only  a  suitable  subset  of  the  information  available  to  it. 

Flexibility  in  the  nature  of  the  information  being  presented  requires 
flexibility  in  the  method  of  presentation  as  well,  since  different  sorts  of 
facts  should  generally  be  presented  using  different  representation  methods. 
An  investigation  of  these  issues  led  tis  to  explore  a  variety  of  criteria  for 
automatic  generation  and  evaluation  of  methods  for  machine  presentation 
of  information  [12,13,  H,  15). 

5  Interacting  Agents 

The  IA  includes  many  “canonical  agents”  working  together.  However,  it  is 
not  always  possible  or  even  desirable  for  the  individual  agents  to  blindly 


obey  one  another;  to  lay  the  foundation  for  an  investigation  of  the  details 
of  multi-agent  interaction,  we  began  by  defining  notions  of  rationality  for 
single  agents.  The  first  case  investigated  dealt  with  agents  in  a  master/slave 
relation,  so  that  each  agent  was  able  to  fully  specify  the  actions  of  other 
agents  in  order  to  carry  out  a  task.  A  solution  to  the  problem  of  ordering 
activities  among  agents  was  discovered  [1G] . 

The  next  problem  considered  dealt  with  the  discovery  of  communica¬ 
tion  strategies  between  agents  with  identical  goals  but  with  incomplete  or 
conflicting  world  models  [17].  Following  this,  we  were  finally  able  to  turn  to 
the  case  of  fully  autonomous  agents  that  would  not  necessarily  cooperate 
but  might  instead  pursue  courses  of  action  intended  to  achieve  potentially 
conflicting  goals.  A  hierarchy  of  rationality  assumptions  was  developed, 
and  we  investigated  the  consequences  of  each  agent’s  assuming  that  the 
behaviors  of  the  others  could  be  described  by  one  or  more  of  the  definitions 
in  the  hierarchy.  The  formalism  developed  allowed  for  the  modelling  of  re¬ 
strictions  on  communication  and  the  exchange  of  binding  promises  among 
agents.  The  work  is  described  in  [10,11,18,20] 

Another  area  of  research  was  on  the  tradeoff  between  communication 
costs  and  parallelism.  It  was  discovered  that  the  communication  costs  in¬ 
curred  in  a  joint  effort  may  outweigh  the  advantages  of  parallel  processing 
in  some  situations,  and  an  efficient  communication  protocol  called  ICSP 
was  developed  to  address  these  problems.  We  also  investigated  a  “Variable 
Supply  Model,”  which  covers  a  large  spectrum  of  strategies  in  the  tradeoff 
between  parallelism  and  communication.  A  case  study  involving  run-time 
allocation  of  deductions  to  multiple  agents  is  presented  in  [21)  and  shows 
various  empirical  breakeven  points  in  the  trade  between  parallelism  and 
reduced  communication  costs.  Another  case  study  is  presented  in  [22j  and 
investigates  the  static  allocation  of  deductions  to  a  large  number  of  agents. 
This  study  attempts  to  make  compile-time  estimations  of  run-time  com¬ 
munication  costs  between  the  agents  and,  based  upon  these  estimations, 
to  distribute  the  database  among  the  various  agents  such  that  agents  with 
a  great  need  to  communicate  will  be  near  to  one  another.  In  addition, 
the  system  can  fold  parts  of  the  database  together  onto  the  same  agent 
in  an  attempt  to  reduce  communication  costs  at  the  expense  of  reduced 
parallelism.  Relevant  references  arc  [21,22,2-1,25,23]. 
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